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Abstract 

Blind image deblurring algorithms have been improving steadily in the past 
years. Most state-of-the-art algorithms, however, still cannot perform per- 
fectly in challenging cases, especially in large blur setting. In this paper, 
we focus on how to estimate a good kernel estimate from a single blurred 
image based on the image structure. We found that image details caused 
by blurring could adversely affect the kernel estimation, especially when the 
blur kernel is large. One effective way to eliminate these details is to apply 
image denoising model based on the Total Variation (TV). First, we devel- 
oped a novel method for computing image structures based on TV model, 
such that the structures undermining the kernel estimation will be removed. 
Second, to mitigate the possible adverse effect of salient edges and improve 
the robustness of kernel estimation, we applied a gradient selection method. 
Third, we proposed a novel kernel estimation method, which is capable of 
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preserving the continuity and sparsity of the kernel and reducing the noises. 
FinaUy, we developed an adaptive weighted spatial prior, for the purpose 
of preserving sharp edges in latent image restoration. The effectiveness of 
our method is demonstrated by experiments on various kinds of challenging 
examples. 

Keywords: Motion deblurring, kernel estimation, image restoration, salient 
structures / edges 

1. Introduction 

Motion blur is a common problem caused by camera shake during the 
exposure period. It gains considerable attention in recent years due to its 
involvement of many challenges in problem formulation, regularization, and 
optimization. It is usually modeled as a linear image degradation process: 

B = I^k + s, (1) 

where 5, /, k and £ represent the blurred image, latent image, blur kernel 
(a.k.a. point spread function (PSF)) and the additive noise, respectively. * 
denotes the convolution operator. It is a well-known ill-posed inverse prob- 
lem, which requires regularization to alleviate its ill-posedness and stabilize 
the solution. 

Significant progress has been made [U El El HI El O [7] . The success of 
these methods comes from the sharp edge restoration and noise suppression 
in smooth regions, which enable accurate kernel estimation. 

However, blurred image with some complex structures or large blur will 
fail most of the current state-of-the-art blind deblurring methods. Taking 
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Fig. [T](a) as an example, due to the camera shake, the motion blur is very 
large, in addition, the blurred image also contains complex structures. As 
shown in Fig. [l](b) ^ (f), some state-of-the-art methods [H EJ |3l [6l [Jj cannot 
restore or select useful sharp edges for kernel estimation due to the large blur 
and complex structures, thus, the correct blur kernels are not obtained. This 
inevitably makes the final deblurred results unreliable. 

We address this issue and propose a new kernel estimation method based 
on the reliable structures. Our method is a new selection scheme to select 
reliable structures adapting to the image characteristics. Thus, it is able to 
get useful sharp edges for kernel estimation. Our deblurred result shown in 
Fig. [l](g) contains fine textures, and the kernel estimate is also better than 
others. 

Based on above analysis, we develop several strategies which are signifi- 
cantly different from previous works in the following aspects. 

1. We observe that the image structural information plays a critical role in 
the deblurring process. Therefore, we develop a novel structure selec- 
tion method which can choose reliable structures effectively adapting 
to the image characteristics. 

2. Conventional kernel estimation methods use hard thresholding to the 
kernel elements to remove noise, which damage the kernel structures 
(e.g.. Continuity). Our method overcomes the disadvantages of existing 
ones to preserve the sparsity and continuity, remove noise in kernels. 

3. We introduce a simple adaptive regularization term that combines our 
final structures to guide the latent image restoration, which preserves 
sharp edges effectively. 
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Figure 1: A challenging example that most current state-of-the-art methods fail, (a) 
Blurred image, (b) Result of Shan et al. [2 . (c) Result of Cho and Lee [1 . (d) Result of 
Xu and Jia [3 . (e) Result of Levin et al [7 . (f) Result of Krishnan et al [6 . (g) Our 
result, (h) Our final salient edges \/S visualized by using Poisson reconstruction method. 
The size of motion blur kernel is 45 x 45. 

We applied our method to some challenging examples, such as the blurred 
images with some complex structures, or with large blur kernels. We found 
that it is able to provide reliable kernel estimates. 

2. Related Work 

Previous image deblurring methods can be roughly separated into two 
categories: non-blind deconvolution and blind deconvolution. In this paper, 
we mainly focus on blind deconvolution. 

In blind deconvolution, early approaches usually impose constraints on 
motion blur kernel and used parameterized forms for the kernels [HI |9] . Re- 
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cently, Fergus et al 0] adopted a zero-mean Mixture of Gaussian to fit for 
natural image gradients, and a variational Bayesian method was employed to 
deblur an image. Shan et al [2j used a certain parametric model to approx- 
imate the heavy-tailed natural image prior. Levin et al [lOj illustrated the 
limitation of the simple maximum a-posteriori (MAP) approach, and efficient 
marginal likelihood approximation was introduced in [7j. However, the ker- 
nel estimates of these methods contain some noises. The hard thresholding 
to the kernel elements method will destroy the inherent structure of kernels. 

Another group methods [H [3l [5j employed an explicit edge prediction 
step for kernel estimation. Cho and Lee [Ij used bilateral filtering together 
with shock filtering to predict sharp edges iteratively, and then selected the 
salient edges for kernel estimation. However, the Gaussian priors used in this 
method can not keep the sparsity of the motion blur kernel and the image 
structure. The final result usually contains noise. Xu and Jia [3j proposed 
an effective mask computation algorithm to adaptively select useful edges 
for kernel estimation, the kernel refinement was achieved by using iterative 
support detection (ISD) method [llj. However, this method only considered 
the sparsity of the motion blur kernel, and the estimated kernel also contains 
some noises occasionally. 

In the final deblurring stage, which is also known as the non-blind image 
deconvolution. The well-known method is the Richardson-Lucy deconvolu- 
tion [12] . Recent works mainly focus on the natural image statistics P, [13] to 
keep the properties of latent images and suppress ringing artifacts. The works 
in [SlIIl] used TV regularization to restore latent images, while the isotropic 
TV regularization will result in stair-casing effect. Krishnan et al [6j used 
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normalized sparsity measure to restore latent images; this regularizer leads 
to the non-convex problem and needs to special method to solve it. In this 
paper, we make use of our final structure to guide latent images restoration 
which preserves more details of latent images. 

3. Motion Deblurring from Salient Structure 

We find that different extraction of structure leads to different deblurred 
results, and extracting reliable structure is critical to deblurring. Thus, we 
focus on extracting more reliable structures, which is achieved by several key 
steps. First, we extract the main image structure (the first part of the red 
box in Fig. [2]); then a shock filter is applied to get the enhanced structure 
(the second part of the red box in Fig. [2]). Finally, some salient edges with 
large pixel values will be selected for the kernel estimation (the third part of 
the red box in Fig. [5]). The details of this process for extracting salient edges 
will be discussed in Section 3A_ The fiowchart shown in Fig. [2] illustrates our 



deblurring process in details. 

3.1. Constructing Salient Structure 

Our method for adaptively selecting salient edges mainly relies on the 
idea of structure-texture decomposition method pLSJ. For an image / with 
pixel intensity value /(x), the structure part is given by the optimizer of the 
following energy 

mm||V/,||2 + ^||/.-/||i (2) 

where 9 is adjustable parameter. The image I{x) is decomposed into the 
structure component Ig (shown in Fig. [3](c)) and the texture component 





Figure 2: The process of our algorithm. 

It = I — Is (shown in Fig.[3](b)). The component Ig contains the major large 
objects in the image while It includes fine-scale details and some noises. 

Fig. |3](f) demonstrates that the accuracy of kernel estimate is greatly 
improved by performing model ([2]). However, model ^ may lead to stair- 
casing eflFect in smooth area. This will cause gradient distortion and introduce 
inaccuracy for blur kernel estimation. A simple way to mitigate this eflFect is 
to adjust the value of 9 to be large in smooth area, and small near the edges. 
Therefore, we employ an adaptive function defined in Eq. ^ to achieve this 
goal. 

_ IIEyeiV.(x)V-g(y)ll2 

^ ^"E,e.,(x)l|V5(y)|b + 0.5' 
where B is the blurred image, and Nh{'x.) is a /i x /i window centered at pixel 
X. A small value r implies that the local region is fiat, whereas large value r 
implies existing strong image structures in the local window. This equation 
is first employed by [3j to remove some narrow strips that may undermine 




Figure 3: Different structures leading to different deblurred results, (a) Blurred image, 
(b) Texture component It- (c) Structure component /g. (d) Results without performing 
model ([2|. (e) Results by using It in the process of kernel estimation, (f) Results by 
using Is in the process of kernel estimation. 



the kernel estimation. 

With this adaptive function r, we reformulate model ^ as follows, 

1 



min V/, 2+ . X , 
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(4) 



where uj{x.) = exp(— ||r(x)||^-^). 

According to above analysis, model Q keeps the similar advantages to 
the method [3j. It also has strong penalty to these areas which are flat or 
contain narrow strips as well. Model Q, however, can adaptively obtain the 
intrinsic image structures. 

As shown in Fig. |4](a), the blurred image contains some complex struc- 
tures, which may have detrimental effects on kernel estimation. The kernel 
estimation result shown in Fig. |4](c) illustrates the effectiveness of our im- 



(a) (b) (c) (d) 

Figure 4: Comparison of results using model Q and our improved model Q. (a) Blurred 
image and truth kernel, (b) Result with model (c) Result with model Q. (d) Result 
of [3]. The results (including the kernel estimate and deblurred result) of our improved 
model Q in (c) performs better than others. 

proved model Q, while the deblurred result of [3j still contains some blur 
due to the imperfect kernel estimation result^ 

After computing the structure J^, we apply the shock filter to enhance 
the structure of Ig and select reliable salient edges to guide the kernel estima- 
tion. Shock filter is an effective tool to restore strong edges from the blurred 
images, and it can be achieved by solving the following PDE problem [T6] . 

= -sign(A/)||V/||2, (5) 

where V/ is the gradient of image, A/ = I^Ixx + "^Ixlylxy + Illyy 

Finally, we use unit binary mask function i/(x, y) to refine the structure 
and mitigate the possible adverse effect to the kernel estimation. 

{1 Xi^t 
(6) 
otherwise 

To increase the robustness of kernel estimation, the final salient edges V S 
can be obtained from 

VS = VIssH{G,t), (7) 



^More comparable results can be found in our supplementary material. 
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where G = (IIV/55II2, ||/j5||i/5\/2, ||/J^||i/5\/2), Igs denotes the shock filtered 
structure J^, /J^, /J^ denote horizontal and vertical derivatives, respectively, 
and t is a threshold of || V/55II2 which is determined by the size of blur kernel. 
By applying Eq. ([t]), some noise existing in the Vlgs will be eliminated. 
Thus, only the salient edges with large values have influences on the kernel 



estimation. The effectiveness of salient edges will be detailed in Section 3.3 



3.2. Robust Kernel Estimation from Salient Structure 

After sharp edges selection, we can estimate the motion blur kernel with 
VS. The traditional model for motion blur kernel estimation is as follows. 



mm\\VB - k^VS\\l + -f\\k\ 



a 



s.t. kix,y)>0; J]A:(x,|/) = 1. (8) 

{x,y} 



Although model ([8|) can preserve the sparsity prior effectively, it does 
not ensure the continuity of blur kernel, and sometimes induces noisy kernel 
estimates, as shown in Fig. [5](e). Noise in the kernel estimate will lead to the 
inaccurate deblurred result (shown in Fig. [5](b)). 

One important observation of the kernel is that its gradient is extremely 
sparse, so the traditional gradient constraints of kernels will not keep the 
property of kernel well, and these constraints sometimes damage the shape 
of kernel. The kernel estimate shown in Fig. [51(d), which is generated by 
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(d) 



(e) 



(f) 



Figure 5: Comparison of results using different spatial priors of motion blur kernel, (a) 
and (d) are results by using model (|9|. (b) and (e) are results by using model (|8|. (c) and 
(f) are our estimated results. Deblurred result in (c) outperform result in (b) (e.g., the 
parts in the red boxes). 

using modej^ 

mm II V5 - * VS\\l + ^WkW^ + \\Vkt, 

s.t. k{x,y)>0; J]fc(x,y) = l. (9) 

with the parameter a = u = 0.5^ demonstrates this case. We can see that it 
fails to produce correct results. 

Based on above analysis, we introduce an effective gradient constraint to 
preserve the continuity and remove noise in the blur kernels. The measure is 
expressed as, 

C{k) = i^{ix,y)\ \dMx,y)\ + \dyk{^,y)\7^0}. (10) 

C{k) counts the number of position (x,^) which satisfies \dxk{x^y)\ + 
\dyk{x^y)\ 7^ 0. It can make the kernel sparse and preserve the continuity 
of the kernel. With this constraint, our final energy for kernel estimation is 

^This kernel estimation model is also employed in [IT]- 
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formulated as, 



min ||V5 -k* \/S\\l + 7||A;||:^ + /iC(fc), 



k 



S.t. k{x,y)>0; J] = 1. (11) 

{x,y} 



where the parameter fi controls the smoothness of k. 



Note that model (11) is hard to be minimized directly due to involving a 
discrete counting metric. Similar to the strategy of [18j, we approximate it 
by alternately minimizing 



mm\\\/B - k^\/S\\l + -f\\k\ 



k 



a 
a") 



and 



s.t. fc(x,2/)>0; J^fc(x,y) = l, (12) 



mm\\k-k\\l + iiC{k). (13) 

k 



Note that model (12) can be optimized by using iterative reweighed least 



square (IRLS) method while model (13) is Lq gradient minimization 
problem which is proposed by [19j. In this work, we employ the alternat- 
ing optimization method of [19j to solve model (13). Alg. [l] illustrates the 



implementation details of model (11) 



We set Itr = 5, and a = 0.5 in our experiment. The parameter is chosen 
according to the size of kernels. Fig. [5](d) ^ (f) show the kernel estimation 
results with different spatial priors, respectively. Our deblurred result and 
kernel estimate shown in Fig. [5](c) and (f), respectively, outperform others. 

Interim Latent Image Estimation: In this deconvolution stage, we 
focus on the sharp edges restoration from the blurred image, thus, we employ 
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Algorithm 1 Robust Kernel Estimation 



Input: Blurred image 5, salient edges VS', and the initial values of k from 
previous iterations; 

for i = 1 ^ Itr {Itr: number of iterations) do 



end for 

Output: Blur kernel k. 

the anisotropic TV model to guide the latent image restoration. It can be 
written as, 



3.3. More Analysis on Kernel Estimation 

Inaccurate sharp edges will induce noisy or even wrong kernel estimates, 
which furthermore deteriorate the final recovered images. In this subsection, 
we demonstrate the eflFectiveness of our salient edges VS and provide some 
analysis about kernel estimation method via some examples. 

As pointed out in Introduction, image details will damage the kernel 
estimation, thus, we proposed to estimate blur kernels by using salient edges 
VS. The salient edges VS are extracted from interim latent images, and it 
contains the gradient with large pixel values. To verify the validity of VS', 
we perform several experiments by using the data from [10]. Furthermore, to 
emphasize the fact that tiny structures may damage the kernel estimation, 
we select the data with rich details such as trees and grass from [lOj (shown 




Solve for k by minimizing model (13); 



k ^ k] 



min||5-fc*/||2 + Ac||V/||i. 



(14) 
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Figure 6: Comparison of results with and without model Q. (a) The ground truth image, 
(b) Kernel estimates without adopting model Q. (c) Kernel estimates of [1 . (d) Kernel 
estimates of [3 . (e) Kernel estimates with model Q. 

in Fig.ga)). 

Fig. |6] shows an example where we apply model ^ in the kernel estima- 
tion process. Due to the proposed structure selection mechanism, the kernel 
estimates (shown in Fig. [6] (e)) outperform the results without adopting this 
strategy (i.e., Fig. |6] (b)). Compared with other structure selection meth- 
ods [HE], our method as a whole outperforms better. This is mainly because 
our structure selection model ^ is able to adaptively preserve more infor- 
mative structures according to the image characteristics. In addition, the 
kernel estimates by [1^ 3j contain some obvious noise, and the continuity of 
some kernel estimates also has been destroyed. From these results we can 



see that our kernel estimation model (11) is able to preserve the continuity 



of blur kernels, and remove noise in the blur kernels effectively. 

In Fig. [tJ Sum of Squared Differences Error (SSDE) is employed to com- 
pare the estimation accuracy for the blur kernels in Fig. [6| We can see 
that the accuracy of kernel estimation by proposed method has been greatly 
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Figure 7: Kernel estimation results comparison in terms of SSDE. 

improved. 

To furthermore address importance of salient edges VS and the effec- 
tiveness of our whole kernel estimation algorithm, we conduct another ex- 
periment shown in Fig. [8| As can be seen from Fig. [8| the SSDE values 
of kernel estimates, without adopting salient edges VS (i.e., the red curve 
in Fig. [s]), are increasing with the iterations. On the contrary, the results 
with structure selection methods (i.e., cyan curve and green curve in Fig.js]), 
performs better. This furthermore demonstrates the importance of salient 
edges. Compared the cyan curve with the green curve, the quality of kernel 
estimates, by adopting the structure selection model ([i]), has been greatly 
improved, and the accuracy and convergency are better than the methods 
without adopting model Q. This is also in line with our understanding (II- 
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Figure 8: Importance of salient edges \/S and the effectiveness of our whole kernel esti- 
mation algorithm. The red curve shows the kernel estimation errors without adopting any 
structure selection strategies. The green curve shows the kernel estimation errors without 
adopting model Q in the proposed structure selection strategy. The cyan curve shows the 
kernel estimation errors with the proposed structure selection strategy. The black curve 
shows the kernel estimation errors with the proposed structure selection strategy, while 
the salient edges are extracted from truth image. 
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lust rated in Introduction and Section 3.1). From the cyan curve and black 



curve, we can see that our salient edges extracted from interim latent images 
performs comparably to the salient edges extracted from truth images. This 
verifies the validity of our structure selection method. 



In addition, an eflFective constraint Eq. (10) is introduced to remove noise 
when reliability of some structures does not be guaranteed. Results shown in 
Fig. [5] demonstrate such a possibility. More illustrative examples are included 
in supplemental material. 

3.4' Final Latent Image Estimation 



Model (14) may lead to the stair-casing effect and destroy textures. To 
preserve more sharp edges and textures, we make use of our predicted struc- 
ture to guide the recovery of the latent image. The predicted structure VS is 
utilized as the weight of spatial prior. Thus, our final model for latent image 
restoration is defined as follows, 

mm \\B-k^ + X{exp{-\\d^S\\^-^)\\dJ\\i + exp(-||a^5||°-^)||a^/||i). (15) 



Both model (14) and (15) can be solved by using IRLS method efficiently. 
Based on above analysis, our deblurring algorithm is summarized in 
Alg-i 

4. Experimental Results and Evaluation 

We compared our method with other state-of-the-art approaches on sev- 
eral challenging examples. In the kernel estimation, all color images are 
converted to gray ones, the initialized value of 9 is set to 1, and t is initial- 



ized according to [Ij. Ac in model (14) is set to 0.005, A in model (15) is set 
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Algorithm 2 The Completed Image Deblurring Algorithm 



Input: Blur image B and the size of blur kernel; 

Determine the number of image pyramid n according to the size of kernel; 



for i = 1 ^ n do 

Downsample B according to the current image pyramid, and get S^; 
for inner Itr = 1 ^ m (m iterations) do 

Select salient edges VS according to Eq. ([7|); 

Estimate kernel k according to Alg. [TJ 



Estimate latent image li according to model (14); 
end for 

Upscale image and set ^ /^; 
end for 



Estimate the final latent image / according to model (15); 
Output: Blur kernel k and latent image /. 
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to 0.003, and 7 in model (11) is set to 0.01. In Alg. [T| solving model (13) 



will produce negative values. We adopt Yuan et al's method [20] to remove 
negative values of blur kernels. In the final deconvolution process, each color 
channel is separately processed. 

We first use a synthetic example shown in Fig. [9] to prove the effectiveness 
of our method. The blurred image contains rich textures and many small 
details, such as fiowers, leaves and grass which increase the difficulty for 
kernel estimation. We compare our method with state-of-the-art motion 
deblurring methods [H EJ [H [3l [6] . Methods of Fergus et al [4J and Shan et 
al [2] fail to provide correct kernel estimation results, and their deblurred 
results still contain some blur and ringing artifacts. Other methods [21 [IJ E] 
provide deblurred results with some ringing artifacts due to imperfect kernel 
estimation results. Our results shown in Fig. [9](g) perform well both in the 
kernel estimation and the final latent image restoration. 

In Table [l| we employ SSDE and PSNR (Peak Signal to Noise Ratio) to 
compare the estimation accuracy for the blur kernels and the restored images 
in Fig. |9} respectively. 

Our method provides higher PSNR value for the restored image. For 
kernel estimates, our method has lower SSDE value. 

Table 1: Comparison of estimated results in Fig. [Qj 



Methods 


[4J 


[2J 


[IJ 


[3J 




Ours 


PSNR of images 


15.45 


14.78 


14.44 


13.47 


15.33 


19.92 


SSDE of kernels 


0.2654 


0.0329 


0.0298 


0.0301 


0.0292 


0.0021 



We then test the effectiveness of our structure selection model Q . Fig.[lO|a) 

19 











i 












(b) 
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Figure 9: Small tiny details such as the grass and leaves are contained in the image, (a) 
Blurred image, (b) Result of Fergus et al. [4 . (c) Result of Shan et al. [2 . (d) Result of 
Cho and Lee [1 . (e) Result of Xu and Jia [3 . (f) Result of Krishnan et al. [6 . (g) Our 
result, (h) The ground truth result. The size of motion blur kernel is 27 x 27. 
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(b) (c) (d) (e) 

Figure 10: Deconvolution results comparison with and without using image structures, 
(a) Blurred image, (b-e) are deblurred results cropped from the red box in (a), (b) Result 
of Shan et al. [2 . (c) Result of Cho and Lee [1 . (d) Result without performing model Q. 
(e) Result with model Q. 

is a real captured image presented in [4J . The deblurred results of j2l [1] con- 
tain some noises. Fig. 10(d) shows our result without performing model ([i]), 



compared with the result shown in Fig. [I0|(e), its quality is lower, indicating 
the importance of structures in estimating kernel. 

For real images with rich textures and small details, our method can 
still achieve good results. Fig. [TT](a) shows a challenging example with tiny 
structures in the blurred image (published in [3j). The methods of Fergus et 
al Shan et al [2j, Cho and Lee [Ij and Krishnan et al [6j can not obtain 
accurate deblurred results, and the kernel estimation results. The method of 
Xu and Jia [3j performs better, but the final deblurred result contains visual 
artifacts (shown in the red box in Fig.[TT](e)), and the kernel estimation result 
contains some obvious noises. Our method outperforms these methods both 
in the kernel estimation and the latent image restoration. Comparing the 
Fig. [TT](g) and Fig. [TT](h), our simple adaptive weighted spatial prior can 
preserve more sharp edges and finer textures in the latent image. 
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Figure 11: A challenging example with much tiny structures contained in the image. They 
greatly increase the difficulty of kernel estimation, (a) Blurred image, (b) Result of Fergus 
et at. [5. (c) Result of Shan et al. [2]. (d) Result of Cho and Lee [1 . (e) Result of Xu 
and Jia [3 . (f) Result of Krishnan et al. [6 . (g-h) Our results. Deblurred results in (g) 



and (h) are generated by model (14) and ( |T5| ), respectively, (i) Kernel estimate in [1 . (j) 
Kernel estimate in [3]. (k) Our kernel estimation result. The size of blur kernel is 45 x 45. 



Another important advantage of our method is that it can deal with large 
blur kernels. The photo in Fig. [T2|(a) is captured by ourselves, whose motion 
blur is quite large. The method of [Ij performs better than that of [3j, but 
the kernel estimation result still contains some noises, and the deblurred 
result is inaccurate in the red box. Due to large blur, methods of [2, 6j 
cannot also produce correct kernel estimation results and their deblurred 
results still contain some obvious blur and ringing artifacts (e.g., the part in 
the red boxes). Our approach, however, generates results that are visually 
comparable. 

Fig. [13] shows another example with large motion blur, and the blurred 
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Figure 12: Large blur kernel estimation, (a) Blurred image, (b) Result of Shan et al. [2j. 
(c) Result of Cho and Lee [1 . (d) Result of Xu and Jia [3 . (e) Result of Krishnan et 
al. [6^. (f) Our result. The red boxes shown in (b-e) contain some ringing artifacts. Our 
estimated blur kernel size is 53 x 53. 

image also contains small details. Our method provides clearer image with 
finer textures. Results of [H [3] still contain some blur. 

Evaluation on the Synthetic Dataset [lOj: We perform quantitative 
evaluation of our kernel estimation method by using the dataset from Levin 
et al [10], and compare our kernel estimation results with the current state- 
of-the-art blind deconvolution algorithms of Cho and Lee [Ij, Xu and Jia [3j 
and Levin et a/.'s latest method [7J. For evaluation with each test case, we 
followed the method used in [lOj . The kernel estimation results of [UlSlIIOj are 
all generated by using the authors' binary codes downloaded online. Then, 
the deblurred results are obtained by using Levin et a/.'s matlab function 
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(a) (b) (c) (d) 

Figure 13: Another large blur kernel estimation example, (a) Blurred image, (b) Result 
of Cho and Lee (c) Result of Xu and Jia [3]. (d) Our result. Our estimated blur kernel 
size is 99 x 99. 

deconvSps .m with the same parameter settings. The error metric is also the 
same as [lOj . 



In Fig.[T4| we plot the cumulative histograms of deconvolution error ratios 
in the same way as [7J . In the x-axis, a number of n shows the percentage of 
test cases whose deconvolution error ratios are below n. Our method provides 
more reliable results than others. 



Fig. 15 shows the corresponding kernel estimation results. One can see 
that our method generates clear and noiseless kernel estimation results. More 
comparison results can be found in our supplementary materials. 



5. Conclusions 

In this work, we developed a novel kernel estimation algorithm based on 
image salient edges. We discovered that image details could undermine the 
kernel estimation, especially for large blur kernels. Therefore, we propose a 
self-adaptive algorithm for image structure-texture decomposition, which is 
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Figure 14: Cumulative histogram of the deconvolution error ratio across test examples. 



able to remove structures with potential aversive effects to the estimation. 
Our kernel estimation model preserves the characteristics of the kernel, such 
as continuity and sparsity, removes noises, further reduces the aversive effects 
caused by the wrong chosen structures. In the final deconvolution step, we 
utilized the structural information for an adaptive weighted regularization 
term to guide the latent image restoration, which preserves the image details 
well. 

We have extensively tested our algorithm, and found that it is able to 
deblur images with both small and large blur kernels especially when the 
blurred images contain rich details. 

Although our method achieves excellent results, it has some limitations. 
One is that the blurred images are textureless. The other is that blurred 
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images contains severe noise and many saturated pixels. Dealing with these 
problems will be our future work. 
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